Elusive Spin Glass Phase in the Random Field Ising Model 
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We consider the random field Ising model and show rigorously that the spin glass susceptibility at equilibrium 
is always bounded by the ferromagnetic susceptibility, and therefore that no spin glass phase can be present at 
equilibrium out of the ferromagnetic critical line. When the magnetization is, however, fixed to values smaller 
than the equilibrium one, a spin glass phase can exist, as we show explicitly on the Bethe lattice. 
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Few disordered spin models have generated as much inter- 
est and studies as the Random Field Ising Model (RFIM). Yet, 
despite four decades of efforts in mathematics and physics, the 
thermodynamic properties and the nature of the phase transi- 
tions still remain debated. Originally proposed by Larkin [l|] 
for modeling the pinning of vortices in superconductors, the 
RFIM has grown to be used for modeling problems as diverse 
as (among others) diluted antiferromagnets in a homogeneous 
external field [2], binary liquids in porous media yfl, Coulomb 
— or electron — glass |4J] as well as systems near the metal- 
insulator transition I5J . The non-equilibrium behavior of the 
RFIM has been used to model the physics of hysteresis and 
avalanches [6] and the model is also popular in the study of 
complex systems, for instance to model opinion dynamics [7]. 
The Hamiltonian of the RFIM reads 



w = - E J - 



tj Si Sj 



hiSi , 



(1) 



<1J> 



where > (usually = 1), the N Ising spins Si = ±1 
are placed at the vertices of a graph (usually a periodic lattice), 
and the {hi} are quenched random fields, usually having ei- 
ther Gaussian distribution with zero mean and variance or 
a bimodal distribution hi = ±£Tr. 

An important controversy concerning the lower critical di- 
mension has been resolved using rigorous argument (H 0], 
and it is now known that the RFIM develops long range order 
for d > 2. Another puzzle is associated to the failure of the 
so-called dimensional reduction property of the RFIM. Stan- 
dard perturbation theory predicts to all orders that the critical 
behavior of the RFIM in dimension d is the same as that of 
the pure Ising model in d — 2 dimensions II 1011 . a fact that vi- 
olates rigorous results [9]. The reason for this failure is often 
related to the presence of multiple metastable states; conse- 
quently the presence or the absence of a spin glass (SG) phase 
in the RFIM has started to attract a lot of attention. 

But is there a thermodynamic SG phase in the RFIM? 
Based on an extension of the RFIM to m-component vector 
spins and the large m expansion [ 11], it has been argued that in 
the phase diagram of the three-dimensional RFIM the param- 
agnetic and ferromagnetic phases are separated by a SG phase 
in which the replica symmetry is broken, as in mean-field spin 
glasses [12]. Studies using perturbative replica field theory 



also show the presence of an intermediate SG phase below six 
dimensions [13], and other claimed that non-perturbative ef- 
fect would lead to a SG phase [14]. Note that a recent work 
01511 uses non-perturbative renormalization group to explain 
the failure of the dimensional reduction without the use of 
replica symmetry breaking. Even in mean field models, the 
question has sparked debates: While in the fully connected 
setting of 111611 no SG phase was observed, some works sug- 
gested the existence of a such a phase on the Bethe lattice! 1711. 
other do not Il8ll . while some remained inconclusive IU9I1 . In 
numerical studies, altough in II20I1 many solutions to the so- 
called naive mean-field equations have been found close to 
the critical temperature, results from equilibrium 112 111 and out- 
equilibrium [22] Monte Carlo simulations in finite dimension 
found no evidences for existence of such a SG phase. 

In this paper, we consider this elusive SG phase in RFIM 
and show rigorously that the SG susceptibility is always 
upper-bounded by the ferromagnetic susceptibility, for any 
lattice, any dimension and any choice of fields. Consequently, 
there cannot be a SG phase out of the critical ferromagnetic 
point/line. Secondly, we revise the solution of the RFIM on 
the Bethe lattice and show that only when the magnetization 
is fixed to values smaller (in absolute value) than the equi- 
librium one a SG phase can exist. Note that the RFIM with 
fixed magnetization appears in many applications involving a 
mapping from a lattice gas, e.g. in the Coulomb glasses or in 
binary liquids. 

A rigorous bound on the spin glass susceptibility — A 
commonly accepted definition of a SG phase is the divergence 
of the SG susceptibility defined as 



XSG 



i,3 



(2) 



where (•) is the thermal average. The susceptibility \SG 1& re- 
lated to the experimentally measured nonlinear susceptibility 
112 311 . In the replica symmetry breaking theory 111 211 the cel- 
ebrated de Almeida-Thouless condition [24] — the smallest 
eigenvalue of the corresponding Hessian matrix being nega- 
tive — implies the divergence of this xsg- The study of xsg 
identifies the SG transition in any theory with (static) replica 
symmetry breaking [32] as well as in the droplet model B25I1 . 
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Let us now consider a RFIM on a fully connected topology 
with Jij > 0, any other topology can be obtained by setting 
Jij = for all pairs of spins which are not nearest neighbors. 
We first prove that, for any value of the external fields and on 
any given sample, connected correlation functions for any pair 
of spins i, j satisfies 



(SiS^o = (s^} - (smsa > o . 



(3) 



In order to do so, we proceed recursively, and show that if this 
holds for a system with N spins, then it holds for a system 
with N+l spins. When N = 2, we have straightforwardly 
{S% S l 2) c = 8 sinh (2/3 Ji2)/Z 2 which is indeed non-negative 
as long as J12 > 0. Consider now a system with N spins Si 
with i = l,...,N such that Mi, j £ [1...N] Eq. OJ holds for 
any choice of the random fields. We add now a new spin Sjv+i 
with couplings J(N+x)i an d external magnetic field h^+i- In 
the iV + 1 spins system we denote w± = P[Sn+i = ±1]- 

We now express the correlations in the systems of N + 1 
spins in terms of the correlations in the system of N spins. 
First, we evaluate correlations involving the new spin Sjv+i: 



(4) 



where the averages are computed in the N spins sys- 

tem whose Hamiltonian has been changed by the addition of 
the term — ^ ± J(jv+i)i£i, which is nothing but a change in 
the random fields. Given that the external fields in the measure 
(■)^ are not greater than the corresponding fields in (•)+ , 
and that susceptibilities are non-negative in the N spins sys- 
tem by assumption, then (Si}_ is not greater than 
and so we have (Sn+iSi) 



(N+l) 



> 0. 



The correlation (SiSj)c (with i,j is given by 

^-(W^-W^)^)^-^)^). (5) 



By the initial assumption, correlations (SjSj)*. ± are both 
non-negative and by the argument used above the last term 
is also non-negative, and so (SiSj)c > 0. This proves 
relation ([3). In fact, what we have proven is a just particu- 
lar case of the Fortuin, Kasteleyn and Ginibre [27] inequality, 
well known in mathematical physics. 

Our main point is that from Eq. © directly follows that the 
SG susceptibility is upper-bounded by the ferromagnetic one: 



XSG 



1 

N ^ 



Xf ■ 



(6) 



This is true on any lattice and for any choice of the external 
fields, as long as the pairwise interactions are non-negative 
(and hence not frustrated). Eq. © implies in particular that 
XSG can not diverge if xf stays finite. We can say even more: 
The fact that the correlation matrix has all non-negative el- 
ements, Cij = (SiSj} c > 0, implies that among all possi- 
ble susceptibilities the ferromagnetic one, xf, is always the 



largest one. This means that, in order to understand whether 
any kind of long range order develops in a RFIM, it is enough 
to check whether the ferromagnetic susceptibility is diverg- 
ing, and this is a great step of reductionism! The param- 
agnetic phase is defined by the non-divergence of xf thus, 
clearly, there is no SG phase for T > T c , where T c is the 
ferromagnetic critical temperature. This statement allows to 
reject many predictions in the literature: All scenarii where 
Xsg diverges while xf is finite II 1 ll 1 1 311 are ruled out. 

In the ferromagnetic phase, T < T c , the xf would diverge 
because of the coexistence between the "up" and the "down" 
phases, with magnetization m + and mT respectively. Never- 
theless, we can select one of these two states by using proper 
boundaries conditions or by adding an infinitesimal field. In 
each of these states the ferromagnetic susceptibility is finite 
(they are not critical and the clustering property holds) and 
therefore the SG susceptibility is again finite. 

The ferromagnetic susceptibility truly diverges only exactly 
at a second order critical point, T c , where two new states are 
generated from the paramagnetic one. At this point the Hes- 
sian, which is the inverse of the correlation matrix, develops 
a zero mode whose eigenvector has all non-negative elements 
(thanks to Cij > 0). In other words, the two new states gener- 
ated by a second order transition will have different magneti- 
zations. The susceptibility xf is thus diverging exactly at T c , 
but leads only to a ferromagnetic long-range order below T c . 

It seems to us that the only scenario, we are unable to ex- 
clude, for existence of a SG phase is to have a dense set (e.g. 
in T) of ferromagnetic critical points. We have, however, no 
reason to believe that such an exotic scenario appears in the 
RFIM (nor actually in any other model that we know of) and 
thus we conclude that there is no SG transition in the RFIM. 

RFIM with fixed magnetization on the Bethe lattice — In 
order to go beyond the strong constraints of Eq. ((6]), we now 
consider a RFIM where the magnetization m is fixed to an 
arbitrary value. In this case, it is worth considering the free 
energy /(to) as a function of the magnetization m. 

If two states exist with different magnetization, m~ < m + , 
and if one fixes the magnetization m € (m~ , m + ), then in 
any finite dimension there is a phase separation between the 
m~ phase and the m + phase, with the appearance of (at least) 
one domain wall. The free energy /(to) is thus concave and 
given by the Maxwell construction between m + and mT . 

Such arguments, however, do not apply when the RFIM is 
defined on a mean-field topology, e.g. on the Bethe lattice — a 
random graph with fixed coordination number, c. Indeed such 
random lattices are expanders, that is the surface-to-volume 
ratio of any subset of vertices does not decrease to zero when 
the subset is made larger (but still much smaller than the en- 
tire lattice). The shape of /(to) thus does not need to be con- 
cave, and indeed we see it develops the double-well shape typ- 
ical of mean field ferromagnets for T <T C (see FigJT}. No- 
tice that mean-field geometries are important in many applica- 
tions, such as statistical inference and combinatorial optimiza- 
tion (e.g. the RFIM with a fixed magnetization corresponds to 
the weighted graph partitioning, a well known NP-hard prob- 
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lem, where the presence of a SG phase is expected). 

Nonetheless the precise determination of f(m) for a given 
sample or even for the ensemble average is a nontrivial task. 
In principle one would like to compute the free-energy in the 
presence of external field H m chosen such that the equilib- 
rium magnetization is exactly m and obtain /(to) = f(H m )+ 
H m m. However, for a double-well shaped f(m) with minima 
in mT and m + , magnetizations in the interval (to - , m + ) are 
in principle unreachable, as the Legendre transform computes 
the convex envelope of the true function f(m). 

We now propose an algorithm for computing /(to) on the 
Bethe lattice even in these situations. Our approach is based 
on the Bethe-Peierls method, also known as cavity method 
lEitl or belief propagation algorithm lEfjl . For every directed 
link (ij) we define a cavity field u.^j as the effective local 
magnetic field which spin j receives from spin i. The cavity 
fields must satisfy the following self-consistent equations 



— tanh 1 | tanh(/3Jy ) 



tanh 



P \H m + K+ ^2 Uk ' 

kedi\j 



, (7) 



where the summation is over all neighbors of i but j. The 
external uniform field H m must be chosen such as to fix the 
global magnetization to the desired value by 



= — tanh 
N ^ 



(8) 



Solved Eqs. d2K|l, the (extensive) free energy is given by 



- 0F = log {2 cosh [p{H m +hi+Y, «j-m)] } 
~ 12 lo S { &sNii 2 coBht9( Ui _M + mn^n )] } . (9) 

ij s— ±1 

In order to fix the magnetization to a value to corresponding 
to the non-convex part of the free energy function f(m), we 
solve Eqs. (08]) by the following iterative scheme that forces 
the procedure to converge to the right fixed point, even when 
this is thermodynamically unstable. (A) Set t = and assign 
random values to {wj^-} and H m . (B) Repeat (i) compute 

{uf\A by Eq. ((7j; (ii) compute H m solving Eq. ([8]) by the 
bisection method; (iii) increment t by 1; until a convergence 
criterion is met or a maximum number of iterations is reached. 
(C) If converged, compute the free energy /(to) using fixed 
point cavity fields and H^. 

Note that the bound derived in Eq. © is valid for any ex- 
ternal field, and therefore for any values of to such that /(to) 
coincides with its convex envelop. This bound is, however, 
not valid for the values of to in the interval (m~, m + ) and 
this is the place we should check for the appearance of a SG 
phase. In order to do so, we study the stability of the Bethe- 
Peierls solution towards the appearance of a SG order with a 
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FIG. 1: (color online) Free energies f(m) and the stability parameter 
A(m) versus the magnetization m on a Bethe lattice of coordination 
c = 6 with Gaussian random fields of unit variance and zero mean. 
Bottom: we show T = 5, T = 4.5 and T = 4.0 (with T c = 4.66); 
notice the appearance of two minima for T < T c . Middle: a low 
temperature case (T = 1). A spin glass region appears when the 
magnetization is fixed to low enough values. Top: the corresponding 
stability parameter A(m) showing the spin glass order for \m\ < 
0.56. 



diverging xsg- There are several different methods for com- 
puting this instability (for a review see appendix C in flU), 
all of them generalizing the de Almeida-Thouless condition 
1 2M ■ The numerically most precise one is to study the fate of 
a small perturbation to the cavity fields l3~lll . that are evolving 
according to the following linear equations 



Su 



(t+i) 

«->2 



du 



(*+i) 



dui 



Su 



(i) 



(10) 



The divergence of the root mean square of the Su's signals a 
local instability and the appearance of a SG phase. In practice 
we measure the parameter A which is the rate of growth of the 
root mean square of the Su's. 

In Fig. Q] we show a typical free energy /(to) on a Bethe 
lattice and the stability parameter A. We clearly see that in- 
deed a SG phase is present for some of the non-equilibrium 
values of the magnetization. Fig. [2] shows the phase diagram 
of the RFIM on a Bethe lattice. Note that on a cubic 3c? lat- 
tice with Gaussian random fields, the transition in zero field 
is at T c ps 4.5 and for zero temperature at H c w 2.3. Cor- 
responding critical values on the Bethe lattice are larger, as 
expected for a mean field approximation. Just as in the mean 
field solution of [16] the ferromagnetic transition is of first 
order for the bimodal distribution of fields at low enough tem- 
perature [for c > 4, at zero temperature spinodal lines end in 
H sp = (c— 1)/2 and H s f = c — 2]. The SG region appears al- 
ways at a smaller value of magnetization than the equilibrium 
one. At zero temperature the ferromagnetic critical point is 
also critical for the SG phase with m = 0. In the renormaliza- 
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FIG. 2: (color online) Phase diagram of the RFIM on the Bethe lat- 
tice with c — 6 with Gaussian (left) and bimodal (right) random field. 
Top panels: Boundary between paramagnetic (P) and ferromagnetic 
(F) phases (red/full line). In the low T region the transition is first 
order for bimodal fields (red dashed line are the spinodals). Below 
the purple dashed line a spin glass (SG) phase exists at zero magne- 
tization m. Lower panels: Equilibrium magnetization tuf (blue/full 
line). A SG phase exist only for m below the purple full line. 



tion group approach this is the relevant fixed point and the SG 
instabilities seen in the perturbative approach could perhaps 
be linked to this fact. 

Conclusions — We have shown that there is no spin glass 
phase at equilibrium in the RFIM, thus closing a long-standing 
debate on the elusive spin glass phase in this model. It is only 
if one fixes the magnetization to non-equilibrium values that a 
true SG phase can exist, as we showed explicitly on the Bethe 
lattice. In finite dimensional systems the existence such a sta- 
ble phase, altough unlikely, remains open. This SG phase, or 
its vestige, although thermodynamically sub-dominant, may 
influence the dynamical behavior of the model. This is partic- 
ularly true at zero temperature where the many local energy 
minima get stabilized. Our rigorous result also puts a large 
question mark on the field theoretical approaches that has lead 
to erroneous conclusions and that are still widely used in stud- 
ies of more complex disordered systems such a spin glasses. 
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